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^ ; 1 Definitions 

Definition 1 The discrete relay channel is defined by two discrete input alphabets Xi and X2, two 
discrete output alphabets and 3^ and a probability density function X2) giving the 

probability distribution on 3^x3^1 for each (xi, X2) € X1XX2. The relay channel is called memoryless 
if the probability of a block of n transmissions is given by p(y, yi|xi, X2) = nr=i P ^2,j)- 

Definition 2 A (2"^ , n) code for the relay channel consists of a source message set W= {1,2,. ..,2"^}, 
\ a mapping function / at the encoder, 

> : f:W^X^, 

0^ . 

O ■ a set of n relay functions 

^ ! X2,i = ti (yi,i, yi,2, yi,i~i) , 

O 

, relay symbol at time i. Lastly we have a decoder 



where the i'th relay function maps the first i — 1 channel inputs at the relay into a transmitted 



Definition 3 The average probability of error of a code with length n for the relay channel is 
^ , defined as 

_c3 ; Pi") = Pr(5(y") / w), 

where W is selected uniformly over W. 

2 Joint-Decoding at the Destination Receiver 

The code construction is essentially the same as the one devised in [CE79, theorem 6] and the same 
procedure for decoding and encoding at the relay is used. The main change is in the decoding at 
the receiver: 

2.1 Decoding at the Destination at Time i 

At time i the receiver decodes Wi-i. 
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1. Prom y(i), the received signal at time i, the receiver decodes Sj by looking for a unique 

s G 5, the set of partition indices used to select X2, such that (x2(s),y(i)) G A*^^^\ From the 
single channel capacity theorem, sec [YcuOl, Ch. 8.4], the correct ,s.; can be decoded with an 
arbitrarily small probability of error by taking n large enough as long as 

Ro<I{X2;Y). (1) 

2. The receiver now knows the set /S^. into which mj-i (the relay message at time i — belongs. 
Additionally, from decoding at time i — 1 the receiver knows Sj-i, used to generate mi-i. 

3. The receiver generates the set C{i — 1) = G W : {yi\{w),y{i — l),X2(sj_i)) G ^e^^^j. 

4. The receiver now looks for a unique tt; G such that (xi(i(7), y(i— 1), yi X2(sj_i)) G 

^g*-"'' for some m € Sg^- If such a unique w exists then it is the decoded Wi-i, otherwise the 
receiver declares an error. 



3 Comparison of the Rate Obtained with Joint Decoding vs. the 
Sequential Decoding of [CE79, theorem 6] 

We now explain why joint-decoding does not improve on the EAF rate. 
The standard EAF expression is given by [CE79, theorem 6]: 

R < I{Xi-Y,Yi\X2) = I{Xr,Y\X2) + I{Xr,Yi\X2,Y) 
subject to /(X2;y) > I{Yi;Yi\X2,Y), 

where p{xi,X2,y,yi,yi) = p{xi)p{x2)p{y,yi\xi,X2)p{yi\x2,yi)- Joint decoding results in the fol- 
lowing rate expression 

R < I{Xv,Y\X2)+mm{I{X2-,Y)-I{Yi;Yi\Xi,X2,Y),I{Xi;Yi\X2,Y)) 
subject to I(X2;y) > I{Yi;Y,\Xi, X2,Y) = IiY,;Yi\X2,Y) - I{Xr,Yi\X2,Y), 

with p{xi,X2,y,yi,yi) = p{xi)p{x2)p{y,yi\xi,X2)p{yi\x2,yi). 

Now fix p{yi\x2, yi), p{xi) and p{x2), and assume that /(X2; Y) > /(Yi; il|-^25 Y)- Then 

I{X2 ;Y)-I{Yi;Yi\Xi,X2,Y)> /(Xi ; fl 1^2 , F ) , 

hence both rate expressions, joint typicality and standard EAF, are identical. Now, consider a 
mapping I X2, 2/1) such that I{Xi;Yi\X2,Y) > and 

I{Yi;Yi\Xi,X2,Y) < I{X2;Y) < I{Yr,Y^\X2,Y). (2) 

In this situation, assuming the same p{yi \x2,yi), joint decoding may provide a positive rate increase 
over the point-to-point rate I{Xi;Y\X2), while [CE79, theorem 6] does not. The rate joint-decoding 
provides in this region is 

R < I{Xi;Y\X2) + /(X2; y) - 7(yi; FilXi, X2, Y). 
Now we can define a time-sharing variable Yi, g G [0, 1] 

[ l-q ,yi = const ^ 3^1. 
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Then under the chain of distribution p(xi)p(x2)p(y, yi\xi, X2)p{yi\x2, yi)p{yi\yi), the joint decoding 
rate can be shown to be: 

R < I{Xi;Y\X2) + mm{I{X2;Y)-I{fr,Yi\Xi,X2,Y),I{Xi-,fi\X2,Y)) 

subject to /(X2;y) > I{Yi;Yi\Xi,X2,Y). 

Now using the above assignment of p(yi|yi) this can also be written as: 

R < I{Xv,Y\X2)+mm{I{X2-,Y)-qI{Yr,Yi\Xi,X2,Y),qI{Xi-,n\X2,Y)) 
subject to I(X2;y) > qI{Yi;Yi\Xi, X2,Y). 

When g = 1 we have the original joint-decoding rate, since (in our example) 

i{X2 ; y ) - /(yi ; Yi |Xi , X2 , y ) < /(Xi ; yi 1x2 , y ) . 

However, decreasing q we get that I{X2;Y) — qI{Yi;Yi\Xi, X2,Y) increases, while 
qI{Xi;Yi\X2,Y) decreases. Therefore, time-sharing Yi we improve upon the rate of joint decoding 
obtained without time-sharing Yi in the region where joint-decoding is supposed to be better than 
EAF. Now, we keep decreasing q until 

I{X2;Y) - qI{Yr,Yi\Xi,X2,Y) = qI{Xv,Yi\X2,Y), (3) 

and we get back to the original expression of [CE79, theorem 6] with a higher rate than joint- 
decoding. Note that /(X2; y) > I{Yi;Yi\Xi,X2, Y) implies that also /(X2; Y) > qI{Yi;Yi\Xi, X2, Y). 
If the solution to the equality is g > 1 then this implies that I{X2;Y) > I(Yi;Yi\X2,Y) and we 
are at the original [CE79, theorem 6] situation to begin with. 

In conclusion, all the rates that joint decoding allows, can also be obtained or exceeded by 
the original EAF scheme with an appropriate time sharing variable (i.e. an appropriate mapping). 
This argument is due to Shlomo Shamai and Gerhard Kramer. 

Note that optimality in (3) implies 

. /, I{X2;Y) 1 . / I{X2;Y) \ 

qopt = min \ 1, — } = mm < 1, — > , 

\ I{Yi;Yi\Xi,X2,Y)+I{Xi;Yi\X2,Y)j [ I{Yi;Yi\X2,Y) j 

hence qopt is the maximum q that makes the mapping p{yi\x2,yi) feasible for [CE79, theorem 6]. 
Therefore, the rate 

R < IiX^■,Y\X2) + min | 1, /^^^^'^ I I{Xr,Yi\X2,Y), 

[ -'(j^i; yi\x2, y ) ) 

is always achievable. Finally, consider again the region where joint decoding is useful (2) 

/(yi;yi|Xi,X2,y) <A^2;y)< /(yi;yi|X2,y) 

^0 <I{X2;Y)-IiYr,Yi\Xi,X2,Y)< I{Yi;Yi\X2,Y) - I{Yi-Yi\Xi,X2,Y) 
^0 <I{X2;Y)-I{Yv,Yi\Xi,X2,Y)< I{Xv,Yi\X2,Y) 

^0 ^ I(X2;Y)-IiYuYi\Xi,X2,Y) ^ 

- I{Xi-Yi\X2,Y) - 

So, applying time-sharing on li with: 

_ /(X2;y)-/(yi;yi|Xi,X2,y) 

^ I{Xi;Yi\X2,Y) 
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to [CE79, theorem 6] yields: 

/(Xi;y|X2)+g/(Xi;yi|X2,F) =/(Xi:y|X2) + /(X2;F)-/(Fi:yi|Xi,X2,y). 

Hence the joint-decoding rate can be obtained by time sharing on the [CE79, theorem 6] expression. 

In conclusion, since joint-decoding can be represented as a special case of time sharing [CE79, 
theroem 6] , we decided that it does not merit a separate publication and we incorporated this into 
our work on the application of time-sharing to estimate-and-forward. 
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